Using generalizability theory to investigate the variability and reliability of EFL composition scores by human raters and e-rater
نویسندگان
چکیده
ABSTRACT: Using the generalizability theory (G-theory) as a theoretical framework, this study aimed at investigating variability and reliability of holistic scores assigned by human raters e-rater to same EFL essays. Eighty argumentative essays written on two different topics tertiary level Turkish students were scored holistically eight who received detailed rater training. The results showed that significantly G-theory analyses revealed considerably inconsistent although they given training more reliable ratings attained when was integrated in scoring procedure. Some implications are for writing assessment practices.
منابع مشابه
Score Generalizability of Writing Assessment: the Effect of Rater’s Gender
The score reliability of language performance tests has attracted increasing interest. Classical Test Theory cannot examine multiple sources of measurement error. Generalizability theory extends Classical Test Theory to provide a practical framework to identify and estimate multiple factors contributing to the total variance of measurement. Generalizability theory by using analysis of variance ...
متن کاملthe differential effects of debate and media analysis as relate to enhancing efl learners critical thinking ability and writing performances
critical thinking ability has an important role in education. accordingly, scholars around the world are searching for new ways for teaching and improving students critical thinking ability. in line with the studies in efl contexts supporting the positive relationship between critical thinking and writing performances, this study investigated the differential effects of halverson’s critical thi...
15 صفحه اولcontribution of setting to the study of characters and the main idea in e. brontes: wuthering heights and t. hardys: return of the native.
this thesis aims to adduce an unmitigated and comprehensive explication concerning the relationship of three significant elements of fiction: setting, chracter and theme. my research is basically placed on two outstanding novels of the 19th century: emily brontes wuthering heights and thomas hardys return of the native. my endeavour lies in studying the correlation among the three above-mention...
15 صفحه اولexamining the relationship between fear of negative evaluation and communication strategies by iranian efl learners
the purpose of the present study was to investigate the relationship between fear of negative evaluation (fne) and communication strategies (css) among iranian efl learners. it was aimed to examine the differences in the use of communication strategies between speakers with high or low degree of fear of negative evaluation. the current study was a case study consisting of 10 english learners at...
the analysis of the role of the speech acts theory in translating and dubbing hollywood films
از محوری ترین اثراتی که یک فیلم سینمایی ایجاد می کند دیالوگ هایی است که هنرپیش گان فیلم میگویند. به زعم یک فیلم ساز, یک شیوه متأثر نمودن مخاطب از اثر منظوره نیروی گفتارهای گوینده, مثل نیروی عاطفی, ترس آور, غم انگیز, هیجان انگیز و غیره, است. این مطالعه به بررسی این مسأله مبادرت کرده است که آیا نیروی فراگفتاری هنرپیش گان به مثابه ی اعمال گفتاری در پنج فیلم هالیوودی در نسخه های دوبله شده باز تولید...
15 صفحه اولذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Porta Linguarum
سال: 2022
ISSN: ['1697-7467', '2695-8244']
DOI: https://doi.org/10.30827/portalin.vi38.18056